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A MULTIPLE-SENSOR CAMERA 

[0001] The present application claims foreign priority benefit of Chinese 

Application No. 20041000571 L4, filed February 15, 2004, the contents of which is 
hereby incorporated by reference in its entirety. 
FIELD OF INVENTION 

[0002] The present invention relates to cameras, and more particularly, to using 

two or more image sensors with a single lens to produce images with different effects. 
BACKGROUND 

[0003] A contemporary camera typically includes a lens and an image sensor. 

Light rays entering through the lens are generally directed to the image sensor. In 
response to the light rays, the image sensors output electronic signals to an electronic 
system, which may record, display or compress the electronic signals fi-om the image 
sensor. Currently, there are various types of image sensors, such as the charge-coupled 
device (CCD) sensors and the complementary metal oxide semiconductor (CMOS) 
sensors. Either a CCD sensor or a CMOS sensor may be used in the contemporary 
camera. Furthermore, each kind of image sensors can be divided into two categories, 
namely, color image sensors and black-and-white image sensors. 
[0004] Many of the existing cameras have only a single image sensor. Although 

color images are preferred in many applications, one issue of the color image sensors is 
that the color image sensors generally have lower optical sensitivity than the black-and- 
white image sensors. The color image sensors may generate sharp images during 
daytime or in a well-lit environment. But at night or in a dark environment, the color 
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image sensors cannot generate images as sharp as those generated by the black-and-white 
image sensors. 

[0005] Furthermore, the existing CCD color sensors typically operate with an 

infrared filter in order to generate images with real-life color. Since the infrared filter 
blocks the infrared light from the CCD color sensors, it is ineffective to supplement the 
natural light with infrared light in a dark environment when using cameras having the 
CCD color sensors. Moreover, even if the infrared filter may be optionally removed 
depending on the lighting condition, such as implemented in one of the cameras provided 
by Sony Corporation, such implementation still does not solve the problem of the lower 
sensitivity of the CCD color sensors. 

[0006] Another potential solution to the. above problem is to provide both a first 

camera having a black-and-white image sensor and a second camera having a color 
image sensor. Hence, one may choose one of the cameras depending on the lighting 
condition. However, the cost of such a setup would be too high to provide much practical 
advantage. 

[0007] Another type of existing cameras includes three image sensors, each of 

which is designated to detect a distinct primary color (e.g., red, green, or blue). Each of 
the color image sensors generates signals of the corresponding individual primary color. 
The real color of a single pixel is determined using the signals from all three image 
sensors. In other words, the three color image sensors are used together to generate a 
single image. These three color image sensors are not intended to be used individually. 
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SUMMARY 

[0008] A multiple-sensor camera is disclosed. In one embodiment, the camera 

includes a single lens, a plurality of image sensors, each of the plurality of image sensors 
having distinct characteristics, and an optical device positioned between the lens and the 
plurality of image sensors to direct Ught rays from the lens to one of the plurality of 
image sensors. 

[00091 Other features of the present invention will be apparent from the 

accompanying drawings and from the detailed description that follows. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



[00101 The present invention will be understood more fully from the detailed 

description that follows and from the accompanying drawings, which however, should 
not be taken to limit the appended claims to the specific embodiments shown, but are for 
explanation and understanding only. 

[0011] Figures 1-3 illustrate one embodiment of a multiple-sensor camera. 

[0012] Figure 4 illustrates an alternate embodiment of a multiple-sensor camera. 

[0013] Figure 5 shows one embodiment of a multiple-sensor camera. 

[0014] Figures 6-8 show another embodiment of a multiple-sensor camera. 

[0015] Figure 9 illustrates one embodiment of a multiple-sensor camera. 

[0016] Figure 10 shows one embodiment of a muUiple-sensor camera. 

[0017] Figure 1 1 shows one embodiment of a multiple-sensor camera. 

[0018] Figure 12 shows one embodiment of a muhiple-sensor camera. 

[0019] Figures 13-16 show one embodiment of a multiple-sensor camera. 

[0020] Figure 17 shows one embodiment of a multiple-sensor camera. 

[0021] Figure 1 8 shows one embodiment of a multiple-sensor camera. 

[0022] Figure 19 shows one embodiment of a multiple-sensor camera. 

[0023] Figure 20 shows one embodiment of a multiple-sensor camera. 
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DETAILED DESCRIPTION 

[0024] In the following description, numerous specific details are set forth. 

However, it is understood that embodiments of the invention may be practiced without 
these specific details. In other instances, well-known components, structures, and 
techniques have not been shown in detail in order not to obscure the understanding of this 
description. 

[0025] In one embodiment, a camera includes multiple image sensors and a single 

lens installed within a housing. The image sensors include different types of image 
sensors. For instance, the image sensors may include a color image sensor and a black- 
and-white image sensor. Furthermore, the image sensors may include one or more CCD • 
sensors and/or CMOS sensors. The light rays from an image may be directed to either 
the color CCD image sensor or the black-and-white CCD image sensor using an optical 
device inside the camera. For example, when taking pictures during daytime or in a well- 
ht environment, the optical device may direct the light rays onto the color CCD sensor in 
order to generate a color image. When taking pictures at night or in a dark environment, 
the optical device may direct the light rays onto the black-and-white CCD sensor in order 
to generate a sharper black-and-white image because the black-and-white CCD sensor is 
typically more sensitive than the color CCD sensor. 

[0026] Figures 1-3 illustrate one embodiment of a camera. The camera includes a 

first image sensor 10, a second image sensor 12. For example, the first image sensor 10 
may be a color CCD sensor and the second image sensor 12 may be a black-and-white 
CCD sensor. The camera fiirther includes a lens 200 and an optical device 20. In one 
embodiment, the optical device 20 can be adjusted or moved. For example, the optical 
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device 20 may be moved within the camera by a mechanical and/or electrical controller. 
Furthermore, the optical device 20 may be operable to reflect light. In one embodiment, 
the optical device 20 includes a mirror. The optical device 20 is installed in between the 
lens 200 and the first and second image sensors 10 and 12. 

[0027] To take pictures during daytime or in a well-lit environment, the optical 

device 20 may be moved away from the path of the light ray such that the Ught ray is not 
blocked from the first image sensor 10. For example, the Ught ray directly falls onto the 
first image sensor 10 in the configuration shown in Figure 1 . In one embodiment, the 
first image sensor 10 is a color CCD sensor, and thus, the camera operates as a color 
camera in this configuration to generate color images. 

[0028] Referring to Figure 2, to take pictures at night or in a dark environment, 

the optical device 20 may be moved by a predetermined angle such that the optical device . 
20 reflects the light ray onto the second image sensor 12 and blocks off the light ray from ; 
the first image sensor 10. The second image sensor 12 may include a black-and-white 
CCD sensor. The black-and-white CCD sensor is more sensitive than the color CCD 
sensor, and thus, is able to produce sharper images than the color CCD sensor in the 
darker environment. Therefore, the camera operates as a black-and-white camera in this 
configuration. 

[0029] Figure 3 illustrates an alternate position at which the optical device 20 

may be placed to allow the first image sensor 10 to receive the light ray from the lens 
200. 

[0030] Figure 4 illustrates an altemate embodiment of the camera. The camera 

includes an optical device 20, a first and a second image sensors 10 and 12, and a lens 
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200. Referring to Figure 4, the optical device 20 having a reflective surface is positioned 
between the first and second image sensors 10 and 12. The optical device 20 may be 
rotated by a first predetermined angle to reflect the light ray onto the first image sensor 
10. Likewise, the optical device 20 may be rotated by a second predetermined angle to 
reflect the light ray onto the second image sensor 12. In one embodiment, one of the 
image sensors 10 and 12 is a color sensor and the other one is a black-and-white sensor. 
By moving the optical device 20 to direct the light ray onto only one of the image sensors 
10 and 12, a user may choose to operate the camera as a color camera or a black-and- 
white camera. 

[0031] Figure 5 illustrates one embodiment of the camera. The camera includes a 

lens 200, a first and a second image sensors 10 and 12, and a prism 20a. The prism 20a is 
positioned between the image sensors 10 and 12. By moving the prism 20a, some or all 
of the light rays through the lens 200 may be reflected to one of the image sensors 10 and 
12. For example, placing the prism at the position indicated by the solid line reflects the 
light ray onto the first image sensor 10. Likewise, placing the prism at the position 
indicated by the dotted line reflects the light ray onto the second image sensor 12. 
[0032] In one embodiment, the image sensors 10 and 12 may include a color 

CIMOS sensor and a black-and-white CMOS sensor. Alternatively, the image sensors 10 
and 12 may include a color CCD sensor and a black-and-white CCD sensor. One should 
appreciate that the image sensors 10 and 12 may include various combinations of 
different types of image sensors in order to produce sharp images under a wide range of 
conditions. 
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[0033] Figures 6-8 illustrate another embodiment of a camera according to the 

present invention. The camera includes a lens 200, a first and a second image sensors 10 
and 12, and an optical device 22. The optical device 22 can reflect a predetermined 
portion of the light ray from the lens 200 and refract another predetermined portion of the 
light ray. In one embodiment, the optical device 22 includes an infrared filter with a 
reflective surface. 

[0034] Referring to Figure 6, the optical device 22 is placed undemeath the lens 

200 during daytime or in a well-lit environment. The light ray from the lens 200 passes 
through the optical device 22 and falls onto the first image sensor 10. The first image 
sensor 10 may be a color CCD sensor. In this situation, the camera may operate as a 
color camera to generate color images. 

[0035] At night or in a darlc environment, it is preferable to use the black-and- 

white sensor because the blaclc-and-white. sensor is typically more sensitive than the color 
sensor. In one embodiment, the second image sensor is a black-and-white sensor. When 
the optical device 22 is moved to a second position as illustrated in Figure 7, the optical 
device 22 reflects the light ray from the lens 200 onto the second image sensor 12. 
Therefore, the camera may operate as a black-and-white camera in this situation to 
generate black-and-white images, which are generally sharper than the color images 
produced by the color sensor. 

[0036] Figure 8 illustrates an altemate way to operate the camera. By placing the 

optical device 22 out of the path of the light ray from the lens 200, the light ray may fall 
onto the first image sensor 10. As mentioned above, the optical device 22 may include an 
infrared filter. Since the light ray does not pass through the optical device 22 in Figure 8, 
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the infrared component of the light ray remains with the Ught ray when the first image 
sensor 10 receives the light ray. Hence, the first image sensor 10 can capture an image 
with infrared effect. In one embodiment, the first image sensor 10 is a color CCD sensor. 
The configuration in Figure 8 allows the color CCD sensor to generate unfiltered color 
images. 

[0037] In sum, the camera illustrated in Figures 6-8 may produce at least three 

different types of images, namely, black-and-white images, color images with infrared 
effect, and color images without infrared effect. A user may use the same camera to take 
pictures under different conditions simply by choosing the appropriate image sensor 
within the camera to receive light rays. 

[0038] As discussed above, the optical device (e.g., the optical devices 20, 22, 

etc.) may be moved to different positions in order to adjust the path of the light ray so 
that the light ray may be directed to different image sensors within the camera. 
Altematively, the optical device may remain stationary, while an electronic controller 
selects the optical signals from one of the image sensors installed within the camera in 
order to generate images with different effects. Figure 9 illustrates such an example. 
[0039] Referring to Figure 9, the camera includes a lens 200, an electronic 

controller 24a, a first and a second image sensors 10 and 12, and an optical device 24. 
The electronic controller 24a is coupled to both the first and the second image sensors 10 
and 12. In one embodiment, the first image sensor 10 is a color CCD sensor and the 
second image sensor 12 is a black-and-white image sensor. The optical device 24 may be 
made of semi-transparent material such that the optical device 24 can filter color 
components of hght rays (e.g., infrared), pass a predetermined portion of incoming light 
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rays, and reflect another predetermined portion of incoming light rays at the same time. 
The first and second image sensors 10 and 12 may include different types of image 
sensors. For example, the first image sensor 10 may include a color CCD sensor and the 
second image sensor 12 may include a black-and-white CCD sensor. A predetermined 
portion of the light ray passes through the optical device 24 and falls onto the first image 
sensor 10. The first image sensor 10 can output signals of a color image. Furthermore, 
the optical device 24 reflects another predetermined portion of the light ray to the second 
image sensor 12 such that the second image sensor 12 can output signals of a black-and- 
white version of the image. 

[0040] As mentioned above, the electronic controller 24a can select the signals 

from either the color CCD sensor 10 or the signals from the black-and-white CCD sensor 
12. Since the electronic controller 24a can select the signals from one of the image 
sensors 10 and 12, it is not necessary to move the optical device 24 to direct the light ray 
onto a particular image sensor. Consequently, it is less Ukely to introduce mechanical 
error that may impact the precision of the camera. 

[0041] Figure 10 illustrates another embodiment of a camera according to the 

present invention. The camera includes a movable opaque panel 25 and a stationary filter 
26. In one embodiment, the filter 26 is operable to pass a major portion (e.g., 
approximately 90%) of the incoming light ray and to reflect a minor portion (e.g., 
approximately 10%) of the light rays. When taking pictures during daytime or in a well- 
lit enviroimient, the opaque panel 25 may be moved away from the filter 26 as shown in 
Figure 10. Thus, a major portion of the Hght ray through the lens 200 passes through the 
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filter 26 and falls onto the first image sensor 10 (e.g., a color CCD sensor). The camera 
operates as a color camera in this situation to output color images. 
[0042] When taking pictures at night or in a dark environment, the opaque part 25 

is moved towards the filter 26 such that the light ray is blocked from the image sensor 10 
(as shown by the dotted line in Figure 10). Since the opaque panel 25 prevents the light 
ray from passing through the filter 26 to the first image sensor 10, the light ray is, instead, 
reflected to the image sensor 12 (e.g., a black-and-white CCD sensor). Hence, the 
camera may operate as a black-and-white camera in this situation to output black-and- 
white images. 

[0043] Figure 1 1 illustrates an altemate embodiment of the camera. The camera 

includes a lens 200, a first and a second image sensors 10 and 12, a filter 26, and an 
opaque panel 25a. The opaque panel 25a may be coupled to the filter 26 at one end as 
illustrated in Figure 1 1 such that the opaque panel 25a may be swung towards or away 
from the filter 26. To take pictures during da5^ime or in a well-lit environment, the 
opaque panel 25a may be swung away from the filter 26 such that the light ray from the 
lens can pass through the filter 26 to fall onto the first image sensor 10 (e.g., a color CCD 
sensor). In this situation, the camera may operate as a color camera to output color 
images. To take pictures at night or in a dark environment, the opaque panel 25a may be 
swung towards the filter 26 (as shown by the dotted line in Figure 1 1) to prevent the light 
ray from passing through the filter 26 to the first image sensor 10. Instead, the light ray is 
reflected onto the second image sensor 12 (e.g., a black-and-white CCD sensor). The 
camera may operate as a black-and-white camera to output black-and-white images in 
this configuration. 
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[0044] Figure 12 illustrates an alternate embodiment of the camera. The camera 

includes a lens 200, a first and a second image sensors 10 and 12, a filter 26, and a liquid 
crystal display (LCD) panel 25b. The LCD panel 25b may allow light rays to pass 
through or to block light rays in response to electrical control signals input to the LCD 
panel 25b. When the LCD panel 25b allows Ught rays to pass through, the Ught ray from 
the lens 200 passes through the filter 26 and then through the LCD panel 25b to the first 
image sensor 10 (e.g., a color CCD sensor). In this situation, the camera operates as a 
color camera to output color images. When the LCD panel 25b blocks light rays, the 
Ught ray fi-om the lens 200 is blocked off fl-om the first image sensor 10. Hence, only the 
second image sensor 12 can detect the light ray as the light ray is reflected onto the 
second image sensor 12. In one embodiment, the second image sensor.l2 is a black-and- 
white CCD sensor. The camera may, therefore, operate as a black-and-white camera to 
output black-and-white images in this configuration. 

[0045] In the embodiments illustrated in Figures 10-12, the path of the light ray 

may be changed or adjusted by moving the opaque panel (e.g., panels 25, 25a, or 25b) 
without moving the filter 26. By keeping the filter 26 stationary, the precision of the 
camera may be improved. 

[0046] Figures 13-16 illustrate one embodiment of the camera. The camera 

includes a first, a second, and a third image sensors 10, 12, and 14, a lens 200, and a filter 
22. The filter 22 can reflect a first predetermined portion of incoming Ught and refiract a 
second predetermined portion of the incoming light. In one embodiment, the filter 22 is 
an infirared filter. Referring to Figure 13, the filter 22 is placed in fi-ont of the third image 
sensor 14 without obstructing the other two image sensors 10 and 12. The light ray 
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through the lens 200 falls directly onto the first image sensor 10 (e.g., a color CCD 
sensor). In this configuration, the camera may operate as a color camera without infirared 
filtering. 

[0047] Under different circumstances, such as different lighting intensities, one 

may switch to a different image sensor in the camera by adjusting the position or the 
angle of the filter 22. For example, the filter 22 may be moved to a first predetermined 
position in between the lens 200 and the first image sensor 10 to reflect the light ray onto 
the second image sensor 12 as illustrated in Figure 14. The second image sensor 12 may 
include a black-and-white CCD sensor. In this situation, the camera operates as a black- 
and-white camera. 

[0048] Furthermore, the filter 22 may be moved to a second predetermined 

position underneath the lens 200 as illustrated in Figure 15. At this position, the filter 22 ^ 
fihers the light ray to remove the infi-ared components from the light ray before passing 
the light ray to the first image sensor 10. In this situation, the camera operates as a color 
camera with infi-ared filtering. 

[0049] Altematively, the filter 22 may also be moved to a third predetermined 

position as illustrated in Figure 16. At this position, the filter 22 reflects the light ray 
fi-om the lens 200 onto the third image sensor 14. Depending on the characteristics of the 
third image sensor 14, the camera may operate as a color or a black-and-white camera in 
this configuration. Therefore, the camera illustrated in Figures 14-16 can provide at least 
four different fimctions. 

[0050] Figure 17 illustrates an altemate embodiment of the camera. The camera 

includes a lens 200, a first, a second, and a third image sensors 10, 12, and 14, a prism 27, 
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and three panels 28, 29, and 30. The panels 28-30 may be made of light blocking 
materials. Altematively, some or all of the panels 28-30 may be LCD panels. Under 
different environments or lighting conditions, the panels 28-30 may operate with the 
prism 27 to direct the light ray from the lens 200 to one of the image sensors 10, 12, or 14 
in order to generate a particular type of image. 

[0051] In one embodiment, the panels 28, 29, and 30 may be moved away from 

the prism 27 such that the hght ray from the lens 200 may pass through the prism 27 to 
fall onto the first image sensor 10. Ahematively, the panels 29 and 30 may be placed on 
or near the surfaces of the prism facing the first and third image sensors 10 and 14 to 
prevent light rays from reaching the first and the third image sensors 10 and 14. Only the 
second image sensor 12 may receive the light ray reflected by the panel 29. Likewise, the 
panels 28 and 30 may be placed on or near the surfaces of the prism facing the first and 
second image sensors 10 and 12 to prevent light rays from reaching the first and the 
second image sensors 10 and 12 such that only the third image sensor 14 may receive the 
hght ray reflected by the panel 28. The image sensor (one of the image sensors 10, 12, 
and 14) receiving the light ray from the lens 200 may output signals of the image 
according to the characteristics of the corresponding image sensor. 
(0052] Furthermore, one may remove two or more of the panels 28, 29, and 30 

from the prism 27 in order to allow more than one of the image sensors 10, 12, and 14 to 
receive a portion of the light ray from the lens 200. The signals generated by the image 
sensor(s) that receive the light ray may be used to produce multiple images with different 
effects. 
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[0053] As mentioned above, the panels 28, 29, and 30 may include one or more 

LCD panels. The LCD panel may be electronically controlled to block or to pass light. 
Therefore, making the LCD panel to pass Ught is functionally substantially equivalent to 
moving the panel away from the prism 27 in the above example. Likewise, making the 
LCD panel to block light is functionally substantially equivalent to moving the panel onto 
or near the corresponding surface of the prism 27 in the above example. 
[0054] Applying the technique discussed above, some embodiments may include 

more than three image sensors to enable the camera to produce images having different 
effects. Furthermore, the image sensors may be parallel to each other or arranged in 
different configurations. Figures 18 and 19 show two examples to illustrate this concept. 
[0055] Referring to Figure 18, the camera includes a lens 200, a first, a second, a 

third, and a fourth image sensors 32, 34, 36, and 38. The image sensors 32-38 are 
arranged in a square with the lens 200 in the center of the square. Figure 1 9 illustrates 
another embodiment of a camera. The camera includes a lens 200 and six image sensors 
41-46 arranged in a circle with the lens 200 in the center of the circle. 
[0056] Figure 20 illustrates one embodiment of a camera. The camera includes a 

lens 200, a first and a second image sensors 10 and 12, and an optical device 40. The 
optical device 40 is installed across from the lens 200. The first and second image 
sensors 10 and 12 are mounted on the same side as the lens 200. The optical device 40 
may be adjusted by a predetermined angle to reflect the light ray from the lens 200 onto 
the first image sensor 10 as illustrated in Figure 20. Likewise, the optical device 40 may 
be adjusted by another predetermined angle to reflect the light ray from the lens 200 onto 
the second image sensor 12. The optical device 40 may include a mirror. Alternatively, 
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the optical device 40 may include a prism. Furthermore, other embodiments of the 
camera may have additional image sensors installed within the camera. The optical 
device 40 may be moved, such as being rotated by a predetermined angle, to reflect the 
light ray through the lens 200 onto one of the image sensors, which outputs signals of the 
image captured. The position and/or the angle of the optical device 40 may be varied in 
order to direct the light ray onto any one of the image sensors in order to produce images 
having certain predetermined effects. 

[0057] In some embodiments, the optical device (e.g., the optical devices 20, 20a, 

22, 24, 26, etc.) may be rotated, laterally moved, etc. to direct the light ray through the 
lens 200 onto a predetermined image sensor in order to produce images having certain 
predetermined effects. 

[0058] Furthermore, in some embodiments, the optical device (e.g., the optical 

devices 20, 20a, 22, 24, 26, etc.) are moved or adjusted using an electronic controller. 
[0059] In some embodiments, the image sensors (e.g., the image sensors 10, 12, 

etc.) remain stationary during the operation of the camera while the optical device (e.g., 
the optical device 20, 20a, 22, etc.) is moved or adjusted to change the paths of the light 
rays entering the camera through the lens. One advantage of keeping the image sensors 
stationary is to avoid introducing a mechanical error that may affect the predetermined 
focus of the camera, and hence, to ensure the images captured are sharp. 
[0060] Furthermore, electronic circuitry may be used in some embodiments to 

select the signals from one or more of the image sensors (e.g., CCD sensor, CMOS 
sensor, etc.) in different applications. By using the electronic circuitry to select the 
signals, the optical device is not moved. Hence, the mechanical errors introduced by 
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physically moving the optical device within the camera can be avoided. Therefore, the 
quality of the captured image can be improved. 

[0061] In one embodiment, the image sensors (e.g., CCD sensors, CMOS 

sensors) may be moved within the camera in order to receive the light ray through the 
lens. For example, the image sensors may be moved horizontally, vertically, etc. 
[0062] In one embodiment, the image sensors may include image sensors having 

the same characteristics. For example, all the image sensors within one embodiment of 
the camera may be color CCD sensors. Alternatively, all the image sensors may be 
black-and-white CCD sensors. Furthermore, all the image sensors may be CMOS 
sensors in one embodiment. Altematively, the image sensors in some embodiments may 
include image sensors of different types having distinct characteristics. For example, one 
embodiment may include both color and black-and-white sensors. One embodiment may 
include both CCD and CMOS sensors. Another embodiment may include a color CCD 
sensor and a black-and-white CMOS sensor. 

[0063] By using a single lens with multiple image sensors within the same 

camera, the camera may provide a wide range of functions for different applications at a 
low cost. Furthermore, the size of the multi-sensor camera may be reduced because only 
a single lens is installed in the camera. 

[0064] The foregoing discussion merely describes some exemplary embodiments 

of the present invention. One skilled in the art will readily recognize from such 
discussion, the accompanying drawings and the claims that various modifications can be 
made without departing from the spirit and scope of the invention. 
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